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PREFACE 

This  study,  undertaken  by  two  behavioral  scientists  and  two  physicians, 
had  several  purposes  at  its  outset.   First,  we  were  concerned  with  the 
evaluation  of  the  program  itself;  specifically,  the  assessment  of  the  learn- 
ing of  the  nurses  who  participated  in  it.   Second,  we  were  interested  in 
the  development  of  an  approach  to  the  relationship  between  continuing 
education  and  the  larger  issue  of  changing  the  duties  of  the  nurse.   Third, 
we  wanted  to  isolate  the  social,  attitudlnal  and  other  factors  associated 
with  changes  in  the  duties   of  the  nurse.   This  last  issue  is  related  to 
the  effective  management  of  this  change  process. 

Although  the  study  was  initially  undertaken  to  provide  the  program 
sponsors  with  information  on  the  effectiveness  of  the  Nurse  Practitioner 
Program,  we  feel  that  this  paper  will  be  of  interest  to  a  wider  audience. 
Groups  conducting  or  sponsoring  continuing  education  programs  may  find  our 
models  useful  for  understanding  the  process  of  role  change  and  may  benefit 
from  our  specific  evaluation  techniques. 

In  addition,  physicians  and  nurses  contemplating  or  involved  with 
changing  the  distribution  of  work  in  their  care  setting,  may  find  our 
analysis  of  the  factors  associated  with  role  change  helpful. 

Finally,  even  though  we  feel  that  we  have  helped  to  clarify  some  of 
the  many  variables  which  relate  to  the  rather  complex  process  of  role 
change,  we  feel  that  we  have  taken  only  a  first  step.   Thus,  we  present  here 
a  "first  order"  analysis  of  the  data;  while  a  more  sophisticated  analysis  of 
the  data  is  presently  underway.   Furthermore,  this  paper  does  not  deal 
explicitly  with  how  health-care  professionals  can  better  manage  the  process 
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of  change  in  the  distribution  of  work  and  responsibility  in  the  care  setting. 
This  vitally  important  "next  step"  is  also  being  addressed  and  an  action 
program  will  soon  be  developed. 

As  a  group,  we  are  convinced  of  the  importance  of  evaluation  in  any 
change  program.   This  study  has  helped  us  to  clarify  our  thinking,  to  be 
specific  about  objectives,  and  to  confront  the  ambiguities  of  measurement. 
We  feel  future  programs  will  benefit  from  this  effort. 


PART  I 
INTRODUCTION 

Part  of  the  effort  to  provide  more  health  care  to  more  people  has 
been  the  expansion  of  the  role  of  the  registered  nurse.    This  involves 
the  continuing  education  of  the  nurse  -  much  of  it  theoretical  as  well  as 
clinical  -  and  the  expansion  of  her  responsibility  for  the  delivery  of 
primary  care.   In  order  to  meet  this  demand  for  continuing  education  of 
the  nurse,  the  Adult  Nurse  Practitioner  Program  at  Massachusetts  General 
Hospital  was  developed.   The  specific  purpose  of  the  program,  jointly 
sponsored  by  the  Department  of  Continuing  Education  and  the  Department  of 
Nursing,  is  to  continue  the  education  of  the  nurse  by  introducing  her  to 
some  new  concepts  and  further  her  capabilities  for  dealine  with  the 
chronically  ill  and  those  patients  with  certain  acute  diseases. 

Purpose  of  the  Study 

The  purpose  of  this  study  is  to  investigate  the  factors  which 
influence  the  nature  and  magnitude  of  the  changes  that  occur  subsequent 
to  the  Nurse  Practitioner  Program.   The  study  is  predicated  on  the  assump- 
tion that  there  will  be  noticeable  change  for  many  of  the  participants, 
but  that  these  changes  will  not  be  identical  in  type  or  extent  for  all 
of  the  participants.   We  expect  that  there  will  be  a  cluster  of  factors, 
some  of  them  individual  (such  as  ability  and  previous  level  of  training) 
and  some  of  them  social  (such  as  the  support  offered  to  the  returning 
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nurse  by  the  pliysicians  with  whom  she  works  and  the  patients  with  whom  she 
has  contact)  which  will  have  significant  effect  on  the  ultimate  impact 
of  the  program. 

The  study  will  concern  itself  with  two  interacting  social  systems. 
First,  we  will  consider  the  nurse  trainees.   Their  skills,  knowledge, 
attitudes,  and  expectations  will  strongly  influence  patient  care.   The 
second  social  system  is  the  "back  home"  environment  to  which  the  nurses 
return.   This  social  system  is  composed  of  patients,  physicians  and  other 
staff,  and  family  and  friends.   All  of  these  groups  are  important  and 
interact  with  one  another  to  determine  the  nurse's  acceptance  of  her  new 
role. 

In  summary,  for  purposes  of  the  study  we  assume  that  the  shifts 
which  occur  in  the  work  that  the  nurses  perform  from  before  to  after  the 
program  are  a  result  of  the  interaction  of  the  program's  skills  training 
with  the  two  social  systems  discussed  above.   It  is  hoped  that  a  more 
complete  understanding  of  these  social  factors  will  be  of  help  in  planning 
future  programs.   In  addition  we  intend  to  raise  some  issues  concerning 
the  Impact  of  education  and  the  management  of  change  in  the  health  care 
delivery  system. 

Model  of  Learning  and  Role  Expansion 

In  order  to  identify  more  clearly  the  relationships  between  the 
social  factors  which  condition  change  in  the  work  performed  by  the  nurse 
and  some  of  the  consequences  of  this  change,  it  is  helpful  to  look  at 
a  model  of  the  process  we  are  studying.   Such  a  model  is  described  below 


and  is  shown  in  Figure  1.1. 

The  model  starts  with  the  nurses'  learning  In  the  Program.   As  a  result 
of  the  classroom  and  practice  sessions,  the  nurse  emerges  with  more  knowledge 
and  skills.   Depending  upon  her  previous  education  and  job  experiences,  the 
amount  and  extent  to  which  this  knowledge  is  new  varies  for  each  nurse. 
Since  most  of  this  learning  has  been  oriented  toward  clinical  applications, 
the  nurse  has  increased  ability  to  perform  certain  health  care  tasks.   While 
in  some  cases  she  has  strengthened  already  existing  skills,  in  other  in- 
stances she  has  developed  entirely  new  skills. 

Once  back  on  the  job,  the  nurse  performs  to  a  greater  or  a  lesser 
extent  in  an  expanded  role.   Over  a  period  of  time  she  realizes  the  extent 
to  which  she  is  actually  able  to  use  what  she  learned  during  the  Program  and 
the  extent  to  which  she  feels  her  job  has  changed.   Using  several  indicators, 
it  is  possible  to  distinguish  those  nurses  who  feel  that  their  jobs  have 
changed  significantly  from  those  nurses  who  feel  that  their  role  in  the 
delivery  of  care  has  not  changed  very  much.   In  addition,  by  contrasting 
these  groups  with  one  another,  we  determine  how  the  activities  of  these 
groups  of  nurses  differ. 

The  extent  to  which  these  changes  in  the  nurses'  work  occur  is 
hypothesized  to  be  influenced  by  attitudinal,  structural,  and  social  factors.  There- 
fore, we  are  concerned  with  the  nurses'  perceptions  of  job  change,  the 
substance  of  these  changes,  and  with  some  of  the  factors  that  are  associated 
with  these  changes. 

The  final  assessment  of  the  impact  of  the  program  are  its  consequences 
for  patient  care.   Making  the  assumption  that  more  able  nurses  deliver 
better  care,  an  assessment  by  the  sponsoring  physician  of  the  nurse's 
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abilities  is  used  to  measure  her  performance.   The  model,  which  is  pre- 
sented in  detail  in  Part  V,  hypothesizes  that  both  learning  and  the 
opportunity  to  practice  are  necessary  for  better  performance. 

Research  Method 

The  Nurse  Practitioner  Program  has  now  been  run  four  times.   The 
first  group  consisted  of  nurses  from  the  Department  of  Nursing  at 
Massachusetts  General  Hospital.   The  second  group,  which  consisted  of  six 
nurses,  and  the  third  group,  which  consisted  of  eight  nurses,  included 
mostly  nurses  from  private  practices.   For  the  latter  two  groups,  the 
program  was  sixteen  weeks,  where  the  nurse  spent  one  day  per  week  in 
"class"  and  spent  her  remaining  time  "practicing"  on  the  job.   The  fourth 
time  the  program  was  given  it  was  condensed  to  one  month  of  intensive 
"classes"  and  practice  sessions.   The  fourth  group  consisted  of  thirteen 
nurses,  eight  of  whom  were  from  community  health  centers. 

In  the  spring  of  1972,  it  was  proposed  that  an  additional  follow-up 
study  of  the  participants  of  the  last  three  groups  be  conducted.    The 
study  utilized  questionnaires  which  were  filled  out  by  both  the  nurses  and 
their  sponsoring  physicians  at  least  two  months  after  completion  of  the 
program.   Twenty-five  nurses  out  of  a  possible  twenty-seven  responded 
(93%) ,  while  twenty-one  out  of  the  twenty-seven  physicians  responded  (78%) 
to  the  questionnaires. 

Other  than  some  background  information,  the  physician's  questionnaire 
consisted  of  a  Physician  Assessment  of  the  nurse's  ability  on     twenty- 
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nine  tasks,  a  description  of  his  reason's  for  wanting  the  nurse  to  go  to 
the  program,  and  a  statement  of  what  changes  in  the  program  would  have 
been  beneficial. 

The  nurses '  questionnaire  is  divided  into  eight  sections  dealing 
with  the  following  areas:   the  nurse's  present  job;  characteristics  of 
the  "ideal  job";  a  "Self-Assessment"  which  asks  the  nurse  to  rate  herself 
in  29  areas  (the  same  list  as  the  physician  assessment);  the  program 
itself  -  reasons  for  wanting  to  go,  how  much  did  the  nurse  expect  to 
use  what  she  learned,  etc. ;  how  much  nursing  education,  job  experiences 
and  the  Nurse  Practitioner  program  have  added  to  the  nurse's  ability 
to  perform  the  same  29  tasks;  the  sources  and  types  of  support  the 
nurse  obtained  subsequent  to  the  program  and  changes  in  her  job;  the 
nurse's  career;  and  some  background  information. 
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PART  II 
IMPACT  OF  THE  PROGRAM  ON  LEARNING  AND  SKILL 

The  first  part  of  the  study  is  concerned  \<iith.   the  impact  of  the  pro- 
gram on  the  learning  and  skill  of  the  participants.   It  was  hypothesized 
that  the  impact  of  the  program  would  differ  both  across  nurses  and  among 
the  different  abilities  and  skills.   In  some  cases  the  nurse's  prior  educa- 
tion and  job  experiences  would  influence  the  amount  of  impact  of  the  pro- 
gram, i.e.,  in  some  areas  the  nurses  might  come  into  the  program  "well 
versed"  and  the  relative  impact  of  the  program  in  these  areas  would  be  less. 

The  data  relevant  to  this  section  are  reported  in  Table  2.1.   In  the 
left-hand  column  and  the  middle  column  are  the  data  from  section  5  of  the 
Nurse  Questionnaire,  the  Assessment  of  the  Educational  and  Job  Experiences, 
The  first  column  lists  the  per  cent  of  nurses  that  rated  the  program  as 
making  the  greatest  contribution  to  her  ability  to  perform  in  each  of  the 
twenty-nine  areas.   The  second  column  lists  the  average  rating  given  the 
program  for  its  contribution  to  the  nurse's  ability.   The  third  column 
lists  the  average  ratings  that  the  nurse  gave  herself  on  her  ability  to 
perform  the  twenty-nine  tasks  (her  "self-assessment"). 

Table  2.1  shows  that  for  the  history  taking  and  physical  exam  skills, 
the  nurses  feel  that  the  Nurse  Practitioner  Program  was  the  greatest  con- 
tributor to  her  ability,  but  in  some  cases  she  still  does  not  feel  pro- 
ficient,  (This  may  be  due  to  a  lack  of  opportunity  to  practice  what  she 
has  learned  in  the  Program.   We  discuss  this  issue  in  Part  V). 

The  impact  of  the  program  on  the  nurse's  screenine  ability  was 
not  so  great,  however,  relative  to  her  other  job  and  educational  experiences 


Table  2.1 

Per  cent  of  nurses  rating  program  as  highest  contributor,  average 
program  rating  and  average  nurses  self-assessment  for  29  tasks. 


Range 


Abilities  and  Skills 

History  of  Physical  Exam 

Use  problem-oriented  medical  record    92 

Evaluate  major  symptoms  AO 

Obtain  a  medical  history  72 

Obtain  a  family  and  social  history  56 

Perform  a  routine  physical  exam  88 

Screening 

Determine  who  should  see  patient  41 

Determine  need  for  attention  from 

telephone  call  22 

Teaching 

Answer  patient's  questions  about 

treatments,  tests  or  disease  32 
Instruct  patient  about  treatments, 

tests  or  disease  36 
Answer  patient's  questions  about 

medication  25 

Instruct  patient  about  medication  32 

Plan  special  diets  32 

Chronic  Care 

arthritis  54 

angina  58 

diabetes  42 

CHF  58 

hypertension  63 

obesity  58 

stroke  30 

chronic  lung  disease  63 

Acute  Care 

VD  54 

URI  44 

UTI  50 

Headache  50 

minor  trauma  42 

Communicate  with  Physician  25 

Write  Prescriptions  24 

Autonomy 

Make  housecalls  without  physician  45 

Care  for  patient  without  direct 

supervision  of  physician  63 


Per  cent  of  nurses  who  rated 

the  Nurse  Practitioner 

Program  as  highest    ^^g_  ^^^^^^ 

of  Program 
(0  to  +2) 


contributor 
(0  -  100%) 


1.8 
1.8 
2.0 
1,9 
1.9 


1.5 


1.8 

1.8 

1.5 
1.7 
1.0 

1.6 
1.7 
1.6 
1.7 
1.9 
1.8 
1.5 
1.7 

1.5 
1.8 
1.9 
1.5 
1.8 

1.6 

1.3 

1.4 

1.8 


Average 
Self -Assessment 
(0  to  4) 


2.6 
3.0 
3.1 
3.0 
2.5 


3.6 


3.4 


3.3 

3.4 

3.2 
3.4 
2.6 

2.5 
2.8 
3.1 
2.9 
3.1 
3.2 
2.4 
2.5 

2.6 
3.4 
3.5 
2.8 
3.2 

3.4 

3.3 

2.3 
3.0 


The  "N's"  for  this  table  range  between  23  and  25. 
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Apparently  the  program  contributed  significantly  to  her  ability  to  determine 
who  should  see  the  patient  (and  she  feels  quite  proficient  at  it),  but 
not  to  her  ability  to  determine  "need  for  attention"  over  the  telephone 
(and  she  still  does  not  feel  too  proficient  at  it). 

In  the  areas  of  teaching  and  answering  the  patients'  questions,  the 
program  apparently  has  been  effective  in  furthering  the  nurse's  abilities, 
This  is  an  area,  moreover,  where  prior  educational  and  job  experiences 
contributed  significantly  to  her  abilities  as  well.   For  two  specific 
abilities  -  answer  questions  about  medication  and  plan  special  diets  - 
the  nurse  feels  fairly  confident.   However,  she  apparently  obtained  these 
abilities  almost  entirely  outside  the  program. 

The  program's  impact  on  the  nurse's  ability  to  treat  the  chronically 
ill  patient  is  significant.   In  most  cases  it  was  the  greatest  contributor 
to  the  nurse's  ability,  even  though  in  some  cases  she  feels  less  pro- 
ficient than  in  others.   However,  in  two  cases  in  particular,  arthritis 
and  diabetes,  the  impact  of  the  program  has  been  low.   In  addition,  the 
nurse  feels  that  dealing  with  patients  suffering  from  stroke  has  been  almost 
ignored  in  all  her  experiences. 

In  treating  patients  with  the  acute  diseases  UR,  UTI ,  and  minor 
trauma,  the  nurse  feels  proficient  and  the  program  has  made  the  greatest 
contribution.   However,  in  treating  VD  and  headache,  the  nurse  does  not 
feel  proficient.   Although  the  program  has  not  contributed  very  much  in 
absolute  terms  to  her  ability  in  this  area,  relative  to  her  prior  educa- 
tional and  job  experiences,  it  is  the  greatest  contributor. 

For  the  abilities  of  writing  prescriptions  and  communicating  with 


the  physician,  the  nurse  feels  that  she  is  proficient,  but  this  ability 
has  come  primarily  from  experiences  prior  to  the  program.   In  contrast, 
the  program  has  been  the  major  contributor  to  the  nurse's  ability  to 
"care  for  the  patient  without  direct  supervision  of  the  physician." 
Finally,  the  program  has  made  some  contribution  to  the  nurse's  ability 
to  make  housecalls.   However,  the  contribution  has  not  been  very  great 
and  the  nurse  does  not  feel  very  proficient  at  it, 

Transfer  of  Program  Learning  to  the  Job 

The  nurses,   in  general,  indicated  that  they  were  very  optimistic 
of  the  amount  that  they  would  be  able  to  utilize  the  knowledge  and  skills 
obtained  during  the  program.   As  shown  in  Table  2.3,  of  the  twenty-five 
nurses,  76  per  cent  expected  to  use  all  or  almost  all  of  their  newly 
acquired  knowledge  and  skills.   For  the  most  part  these  expectations 
were  confirmed  in  actual  practice;  for  fully  68  per  cent  of  the  nurses 
used  "all"  or  "almost  all"  of  what  they  learned,  while  only  12  per  cent 
of  the  nurses  report  that  they  have  only  utilized  "some"  of  what  they 
learned.   In  summary,  almost  all  of  the  nurses  found  that  they  have  been 
able  to  utilize  a  great  deal  of  what  they  learned. 

Table  2.3 

How  Much  of  What  You  Were  Taught  in  the  f^urse  Practitioner  Program 

Did  You  Expect  to  Use?  Did  You  Actually  Use? 

0 

12% 

20% 

A8% 

20% 
100% 
(25) 


Very  little 

0 

Some 

0 

Most 

2A% 

Almost  all 

48% 

All 

28% 

100% 

(25) 

PART  III 

Up  until  now  we  have  largely  been  concerned  with  the  specific  aspects 
of  the  program,  for  we  have  been  looking  at  the  extent  to  which  the  nurses 
feel  that  they  have  learned  new  things  and  at  whether  they  feel  they  are 
using  them  on  their  jobs.   However,  we  are  specifically  interested  in  the 
change  in  a  nurse's  total  job  —  in  the  extent  to  which  she  has  become  a 
Nurse  Practitioner. 

Defining  an  Index  of  Job  Change 

In  defining  the  extent  of  a  nurse's  job  change,  we  combined  two 
related  factors.   First,  the  question,  "How  different  is  the  work  you  are 
doing  now  from  the  work  you  were  doing  prior  to  the  Nurse  Practitioner 
Program?"   Second,  we  believe  that  the  major  contrast  between  the  Nurse 
Practitioner  role  and  the  traditional  nursing  role  is  one  of  responsibility 
(the  amount  the  nurse  "owns"  the  results  of  her  actions).   Therefore,  the 
question  on  the  extent  to  which  the  nurse  feels  her  responsibility  has 
increased  was  included.   These  two  questions  form  our  index. 

From  now  on  we  will  refer  to  the  five  nurses  whose  jobs  have  changed 
little  and  whose  responsibility  has  only  increased  "some"  or  not  at  all 
as  "low  changers".   The  "medium  changers"  are  those  nine  nurses  whose  change 
in  job  was  moderate  and  whose  responsibility  increased  "some"  subsequent 
to  the  program.   Finally,  the  "high  changers"  are  the  11  nurses  whose  jobs 
have  changed  a  great  deal  and  whose  responsibility  has  increased  "some"  or 
"a  lot"  or  those  whose  responsibility  has  increased  "a  lot"  and  whose  job 
has  changed  a  moderate  amount. 
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Examining  the  Index 

Before  we  go  into  detail  about  how  the  jobs  of  the  high,  medium  and 
low  changers  differ  from  one  another,  we  will  look  briefly  at  the  relation- 
ship of  the  index  of  job  change  to  several  other  important  factors.   For 
example,  our  description  of  the  nurse  practitioner  role  indicates  that  in 
this  expanded  role,  the  nurse  delivers  care  on  her  own.   Thus,  we  would 
expect  that  our  high  changers  would  have  increased  their  autonomy  (the 
amount  of  things  she  does  on  her  own)  more  than  the  other  groups.   A  similar 
expectation  holds  for  increases  in  authority  (the  amount  of  things  she  can 
decide) . 

Table  3.1  supports  these  expectations.   Of  the  high  changers,  90  per 
cent  increased  their  autonomy  "a  lot"  while  only  7  per  cent  of  the  medium 
and  low  changers  increased  their  autonomy  to  this  extent.   Similarly, 
while  55  per  cent  of  the  high  change  nurses  increased  their  authority 
a  lot,  only  14  per  cent  of  the  medium  and  low  changers  increased  to  this 
extent . 

Table  3.1 

Per  cent  of  High  and  Mediuia  and  Low  Cliangers  that  Have 
Increased  their  Autonomv  and  Authority  "a  lot" 

Autonomy  Authority 

High  Changers  90  (11)  55  (11) 

Medium  and  Low  Changers        7  (14)  14  (14) 
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Thus  the  "high  change"  nurse  feels  she  has  changed  the  kind  of 
work  she  is  doing  and  largely  incref^sed  the  amount  of  responsibility 
she  has;  she  has  also  increased  the  amount  of  autonomy  a  great  deal;  and, 
more  than  likely,  she  has  been  granted  moderate  to  great  increases  in 
authority  as  well.   In  contrast,  the  moderate  and  low  change  nurses  have 
lesser  changes  in  each  of  these  areas.   This  is  not  to  say  that  they  have 
not  changed  at  all.   On  the  contrary,  none  of  the  nurses  reported  that 
the  work  they  are  doing  now  is  "very  little"  different  than  their  work 
before  the  program.   Our  labeling  of  the  extent  of  change  as  high,  medium 
and  low  is  purely  arbitrary  —  it  is  relative  rather  than  absolute. 
This  distinction  allows  us  to  examine  the  extent  of  change  as  opposed  to 
whether  change  has  occurred  at  all. 

A  Day  in  the  Life  . .  . 

We  expect  that  those  nurses  that  have  changed  the  most  the  kind  of 
work  they  do  subsequent  to  the  program  will  spend  their  days  differently 
from  those  nurses  who  have  changed  to  a  lesser  extent.   To  explore  this 
further,  we  will  compare  the  "high"  and  "low"  change  groups  of  nurses  on 
the  amount  of  time  they  spend  during  an  "average"  day  performing  certain 
kinds  of  activities.   Table  3.2  summarizes  the  median  time  spent  (based 
on  an  8 -hour  day)  by  the  high  and  low  changers  for  each  of  the  eight 
work  categories. 

As  shown  in  Figure  3.1  the  median  time   spent  by  high  change  nurses 


For  the  purposes  of  comparison,  we  have  chosen  the  median  time  spent 
by  the  nurses  in  the  high  and  low  change  groups.   This  gives  us  a  measure 
of  central  tendency  of  the  time  distributions  and  it  avoids  the  biasing 
of  the  mean  produced  by  extreme  high  or  low  times. 
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Figure  3.1 

MEDIAN  TIME  SPENT  (BASED  ON  8  HOITR  DAY) 
AND  RATIO  OF  TIME  SPENT  FOR  HIGH  CHANGE 
VS.  LOW  CHANGE  NURSES  FOR  EACH  OF  8  WORK 
CATAGORIES . 


M 

E  1^5 

D 

I 

A 

N   1 

H 
0 
U   k 


m  0   HIGH  CHANGE  NURSES 

• .-^  LOW  CHANGE  NURSES 

(     )  RATIO  OF  AVERAGE 
TIMES 


(0.29) (0.70) (0.57) (0.95) (0.92) (0.98) (1.91) (1.74) 


Adminis 
tration 


Advocacy 


Direct 
Support 


Planning 


iching 


Case 
Conferencing 

History  Physical 

Exam 


WORK 


ATAGORIES 


on  administrative  and  clerical  activities  is  less  than  one-third   of 
the  median  time  spent  on  these  same  activities  by  the  low  change  nurses. 
Instead  of  spending  their  time  on  these  activities,  the  high  change  nurses 
are  spending  approximately  twice  as  much  time  as  the  low  change  nurses 
on  case  conferencing  and  seventy-five  per  cent  more  time  doing  physical 
examinations.  At  least  in  the  short  run,  the  trend  seems  to  be  for  the 
high  change  nurse  to  spend  less  time  on  administrative  activities  and  more 
on  physical  exams  and  conferencing. 


Ratios  rather  than  absolute  time  differences  have  been  computed  to 
highlight  the  relative  differences  between  the  two  groups.   In  addition 
to  the  computation  of  ratios  for  each  activity,  the  time  of  the  two  groups 
have  been  compared  using  the  Mann-Whitney  U  test.   Differences  between  the 
groups  reach  statistical  significance  in  the  case  of  Administration  (p  _<  .01). 
Case  conferencing  (p  _<  .02),  and  Advocacy  (p  _^  .10).   In  the  case  of 
Physical  examinations  and  Direct  Support/Treatment,  overlap  of  the  distribu- 
tions raises  the  probability  levels  beyond  statistical  significance. 
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PART  IV 
FACTORS  ASSOCIATED  WITH  HIGH  AND  LOW  CHANGERS 

Using  an  index  of  job  change,  we  have  been  able  to  distinguish 
between  "high"  and  "low"  changers  as  to  the  way  they  spend  their  time 
and  their  autonomy  and  authority  in  the  work  they  do.   In  this  part  we 
are  concerned  with  those  factors  —  attltudinal,  structural,  and 
social  -  which  are  associated  with  the  extent  of  change.   The  attitudinal 
factors  include  the  nurse's  desire  to  change  her  job  and  her  values  re- 
lated to  her  job  and  work  in  general.   The  primary  structural  factor  is 
the  extent  of  change  in  the  office  layout.   The  amount  and  types  of 
support  the  nurse  receives  from  different  sources  for  changing  the  work 
she  performs  are  the  primary  social  factors. 

The  first  attitudinal  factor  is  displayed  in  Table  4.1.   As  shown, 
the  nurse's  desire  to  change  the  nature  of  her  work  (prior  to  hearing 
about  the  Nurse  Practitioner  Program)  is  clearly  related  to  the  extent 
of  change.   Of  those  nurses  who  had  "very  little"  desire  to  change  the 
work  they  were  doing,  33  per  cent  were  high  changers  subsequent  to  the 
program.   On  the  other  hand,  of  those  nurses  with  "a  lot"  of  desire  to 
change   their  work,  54  per  cent  were  high  changers.   The  nurse's  desire 
to  change  is  clearly  related  to  changes  subsequent  to  the  program. 

The  second  attitudinal  factor  is  the  physician's  desire  to  see  a 
change  in  the  work  that  the  nurse  performs.   For  this  factor,  we  asked 
the  nurse  to  assess  the  extent  to  which  she  thought  her  sponsoring 
physician  wanted  her  to  change  the  work  she  performed.   As  shown  in 
Table  4.2,  in  those  cases  where  the  nurse  felt  that  there  was  "very 


Table  4.1 

The  Relationship  Between  the  Nurse's  Desire 
to  Change  and  the  Index  of  Change 


Nurse's  Desire 

Per  1 

Cent  that  are 

to  Change 

High  Change  Nurses 

Very  little 

33% 

In  between 

33% 

A  lot 

54% 

N 

(6) 
(6) 

(13) 


little"  desire  on  the  part  of  the  physician  for  her  to  change  her  work, 
only  20  per  cent  of  the  nurses  subsequently  became  high  changers.   In 
contrast,  of  the  nurses  who  perceived  their  sponsoring  physician's  desire 
to  have  them  change  as  "a  lot,"  86  per  cent  are  hgih  changers.   Therefore, 
not  only  is  the  nurse's  desire  for  change  related  to  the  extent  of  change, 
but  also  her  assessment  of  the  physician's  desire  is  associated  with  the 
change  in  her  work. 

Table  4.2 

The  Relationship  Between  the  Physician's  Desire 
to  See  the  Nurse  Change  (as  seen  by  the  nurse)  and 
the  Index  of  Change 
Nurse's  Perception  of 

Physician's  desire  to     Per  cent  that  are 
see  nurse  change high  change  nurses        _N_ 

Very  little  20%  6 

In  between  0%  5 

A  lot  86%  7 

A  third  set  of  attitudinal  factors  associated  with  the  extent  of 
change  in  the  work  performed  by  the  nurse  are  her  values  related  to  her 
work  and  job.   One  way  we  can  look  at  these  job  values  are  as  motiva- 
tors or  goals  toward  which  the  nurse  strives  on  her  job;  one  can  expect 
the  nurse  to  try  to  structure  her  job  in  such  a  way  as  to  meet  these  needs 
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as  much  as  possible.   By  isolating  those  job  values  that  are  associated 
with  the  extent  of  change,  we  are  isolating  some  of  the  needs  which  are 
characteristic  of  the  high  changers.   In  this  way,  we  add  to  our  under- 
standing of  some  of  the  attitudinal  factors  associated  with  the  expansion 
of  the  nursing  role. 

Among  the  values  which  seemed  to  be  particularly  characteristic  of 
the  expansion  of  the  nursing  role  are  the  nurse's  desire  to  make  a  con- 
tribution to  her  office,  to  perform  challenging  work,  and  to  obtain  a 
sense  of  accomplishment.   As  shown  in  Table  4.3,  there  is  a  direct 
relationship  between  the  importance  given  these  job  values  and  the 
extent  of  change  in  the  work  the  nurse  performs,  i.e.,  the  high  and 
medium  changers  feel  that  these  values  are  more  important  than  the 
low  changers. 

In  addition  to  the  association  of  these  three  attitudinal  factors 
to  the  expansion  of  the  nurse's  role,  the  structural  factor,  changes 
in  the  office,  is  also  associated.   Changes  in  the  office  enable  the 
nurse  to  expand  her  role  and  encourage  expansion  to  continue.   For 
example,  without  her  own  examining  room  or  office  the  nurse  may  find  it 
exceedingly  difficult  to  see  patients  on  her  own,  but  once  she  has  a 
room  she  may  quickly  build  a  caseload.   These  kinds  of  structural 
changes  are  also  an  indication  of  the  commitment  of  the  "office"  to 
expanding  the  nurse's  role.   The  findings  shown  in  Table  4.4  support 
the  association  between  structural  changes  in  the  office  and  the  extent 
of  change  in  the  nurse's  work.   In  those  situations  where  there  has 
been  "very  little"  change  in  the  office,  only  18  per  cent  of  the 
nurses  were  high  changers  while  46  per  cent  were  low  changers.   However, 
in  those  offices  where  there  was  a  "great  deal"  of  change,  60  per  cent 


Table  4.3 

i 

Relationship  Between  Job  Values  and  the  Index  of  Change 


Desire  to  Make 

Sense 

Index  of 

Contribution 

Challenging 

of 

Change 

to  Office 
3.8 

Work 

Accomplishment 

Low 

4.4 

4.4 

Medium 

4.4 

4.8 

4.6 

High 

4.5 

4.8 

4.7 

Changes  in  Office 

High  Changers 

Very  little 

18% 

Medium 

62% 

Great  deal 

60% 

Values  shown  are  means  on  a  scale  from  1  (value  not  important  to 
work)  to  5  (very  important)  for  N  =  25. 


Table  4.4 

The  Relationship  Between  Changes  in 
Office  Practices  and  the  Index  of  Change 

Per  cent  that  are        Per  cent  that  are 

Low  Changers         N 

46%  11 

0%  8 

0%  5 


of  the  nurses  were  high  changers  and  none  of  them  were  low  changers. 

So  far  we  have  shown  that  a  number  of  attitudinal  and  structural 
factors  are  associated  with  the  role  expansion  of  the  nurse.   The 
attitudinal  factors  include  the  desires  of  the  nurse  and  the  physician 
to  bring  about  change  in  the  role  of  the  nurse.   These  desires  represent 
attitudes  prior  to  the  program.   After  the  program,  however,  there  are 
factors  other  than  changes  in  office  practices  which  support  the  changes 
in  the  nurse's  role.   We  call  them  "social  support  factors"  and  they 
include  several  types  of  support  from  the  physician,  the  patients,  and 
the  family  and  friends  of  the  nurse.   These  are  the  people  with  whom  the 
nurse  interacts  the  most,  and  it  is  from  them  that  she  must  depend  for 


encouragement  and  guidance  in  the  cementing  of  the  new  skills  that  she 
has  obtained  in  the  program.   Furthermore,  the  nurse  seeks  acceptance  of 
her  new  behaviors,  and  the  extent  to  which  these  behaviors  are  accepted 
and  encouraged  will  influence  the  extent  to  which  the  nurse  continues  to 
expand  her  role  and  strengthen  her  skills. 

Turning  to  the  results  of  the  study  on  "social  support",  we  see  that 
there  is  a  distinct  relationship  between  the  amount  of  support  and  change 
in  the  nurse's  work.   For  each  of  the  five  types  of  support  given  by  the 
physician  (Table  A. 5),  in  those  cases  where  the  nurse  was  given  "a  lot" 
of  support,  the  percentage  of  high  changers  is  greater  than  when  the 
physician  gave  "some"  or  "no"  support.   For  instance,  in  those  cases  where 
the  physician  gave  the  nurse  a  lot  of  "moral  support",  66  per  cent  of 
the  nurses  were  high  changers.   In  comparison,  in  those  cases  where 
the  physician  gave  "some"  support,  only  11  per  cent  of  the  nurses  were 
high  changers ,  and  there  were  no  high  changers  in  the  cases  where  the 
physician  gave  no  moral  support. 

Table  4.5 

Relationship  of  5  Types  of  Physician 
Support  to  Index  of  Change 

Per  Cent  That  are  High  Changers  for 
Each  Type  and  Amount  of  Support 

Help 
Amount  of  Moral       Sharing  of     Respect         Integrate 

Support       Praise     Support     Knowledge      for  Ability     New  Skills 


None  0%  (1)     0%  (2) 

Some  11%  (9)     20%  (5) 

A  lot         66%  (15)   53%  (17) 


~   (0) 

--   (0) 

0%  (2) 

33%  (6) 

25%  (8) 

30%  (10) 

44%  (18) 

50%  (16) 

58%  (12) 
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Table  A.  6 

Relationship  of  Patients  and  Family  and  Friends' 
Support  to  Index  of  Change 

Per  Cent  That  are  High  Changers 
For  Each  TypS'  nnd  Amount  of  Support 

Family  and  Friends 
Amount  of  Support  Patients  Praise        Praise  Moral  Support 

None  --  (0)  "  (0)    "  (0) 

Some  11%(9)  0%(3)     40%(5) 

A  lot  64%(14)  46%(15)   44%(16) 


The  same  relationship  exists  between  the  amount  of  support  from  the 
patients  and  from  the  nurse's  family  and  friends  and  the  extent  of  change. 
(Table  4.6).   In  those  cases  where  the  nurse  receives  "a  lot"  of  support,  the 
percentage  of  high  changers  is  more  than  when  she  receives  less  support. 
What  the  results  indicate  is  that  the  social  support  factors  are  clearly  re- 
lated to  the  index  of  change.   From  all  three  sources  of  support  —  the 
physician,  the  patients,  and  the  family  and  friends  —  the  extent  of  change 
in  the  nurse's  work  is  related  to  the  amount  of  support  that  she  receives. 

A  summary  of  the  factors  associated  with  high  and  low  changers  is 
shown  in  Table  4.7  .   Some  of  these  factors  are  attributed  to  the 
physician,  while  others  represent  the  nurse's  attitudes  and  values.   Other 
factors  are  the  extent  of  changes  in  the  office,  and  the  amount  of  support 
the  nurse  receives  from  patients,  family  and  friends. 


These  results  are  preliminary;  some  further  analysis  is  presently 
being  conducted.  ■ 
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Summary  of  the  Factors  Associated 
with  High  and  Low  Changers 


Source  of  These  Factors 


Desire  to  change  her 
work 


Desire  to  contribute  to 
the  office 


Desire  to  perform 
challenging  work 


Desire  to  get  sense  of 
accomplishment 


1.  Communicates  to  nurse  his  desire 
to  have  her  change. 

2.  Gives  praise 

3.  Provides  moral  support 

^.  Shares  knowledge 

5.  Shows  respect  for  ability 

6-  Helps  integrate  new  skills 


Other 

1.  Changes  in  office 

2.  Praise  and  moral  support  from  family  and  friends 

3.  Praise  from  patients 


PART  V 


IMPACT  ON  THE  QUALITY  OF  CARE 

Using  the  Physician's  Assessment 

The  final  measure  of  the  program's  success  is  its  impact  on  patient 
care.   The  measurement  of  this,  however,  has  always  been  exceedingly 
difficult  and  beyond  the  feasibility  of  this  study.   Nevertheless,  to 
leave  our  analysis  at  this  point  without  attempting  to  relate  change  to 
improved  care,  would  be  incomplete. 

We  can  assume,  all  other  things  being  equal,  that  more  able  nurses 
deliver  better  care.  This  has  been  the  assumption  in  the  design  of  the 
Nurse  Practitioner  Program  as  well  as  the  assumption  in  other  settings. 
Therefore,  if  we  can  assess  the  nurse's  competence  in  the  skill  and  ability 
areas  we  have  examined  in  Part  II,  then  we  will  have  some  indication  of 
the  quality  of  care  that  the  patients  are  receiving. 

As  an  indicator  of  the  nurses'  ability  to  perform  the  skills  and 
abilities,  we  will  use  the  Physician's  Assessment.   Each  nurse's  sponsoring 
physician  was  asked  to  rate  his  nurse  on  the  29  skills  and  abilities  related 
to  the  goals  of  the  program.   In  the  absence  of  a  more  objective  measurement, 
we  feel  that  this  Physician's  Assessment  gives  a  fair  picture  of  the  nurse's 
level  of  skill. 

Theory  and  Practice 

As  we  have  pointed  out  earlier  in  this  report,  the  expansion  of  the 

nursing  role  is  a  two  stage  process.   First  the  nurse  obtains  knowledge  and 

skills  (learning)  and  then  she  applies  this  learning  in  the  care  setting. 
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This  Implies  that  in  order  for  the  nurse  to  implement  her  learning,  she 

must  have  an  opportunity  to  practice  what  she  has  learned.   Diagrammatical ly, 

this  is  presented  in  the  figure  below. 


PROGRAM      OPPORTUNITY   ^   BETTER      BETTER 

LEARNING     TO  PRACTICE     PERFORMANCE        *  CARE 


Figure  5.1 

We  have  shown  in  Part  III  that  our  sample  of  nurses  contains  some 
people  who  have  changed  the  kind  of  work  they  do  more  than  others.   In 
this  section  we  will  show  that  those  who  have  changed  the  kind  of  work 
they  do  the  most  (high  changers)  are  rated  as  being  better  able  to  perform 
many  tasks  and  abilities  than  those  who  have  not  changed  as  much.   In 
other  words,  those  nurses  whose  jobs  have  changed  the  most  are  getting 
the  opportunity  to  implement  the  learning  they  have  acquired  as  a  result 
of  the  program.   These  nurses  are  perceived  to  be  quite  competent. 
However,  those  nurses  without  this  opportunity,  i.e.,  without  the  chance 
to  apply  what  they  have  been  taught,  are  not  perceived  to  be  as  highly 
competent  by  their  sponsoring  physicians. 

Table  5.1,  which  follows,  is  organized  in  the  same  way  as  Table  2.1. 
As  can  be  seen  from  the  chart,  for  most  of  the  skills  or  abilities  listed, 
a  greater  proportion  of  the  high  changers  are  seen  as  possessing  a  high 

ability  than  the  medium  and  low  change  groups.   Specifically,  of  the  29 

listed  skills  and  abilities,  55  per  cent  follow  the  predicted  pattern; 

in  28  per  cent  of  the  cases,  skill  level  is  independent  of  change  in  job; 

while  in  17  per  cent  of  the  cases  the  relationship  is  reversed. 


Table  5.1 

Per  Cent  of  "High  Change"  Nurses  Rated  by  Sponsoring  Physician 
as  Having  a  High  Ability  to  Perfonn  each  of  29  Tasks  vs.  Per  Cent 
"Medium"  or  "Low  Change"  Nurses  Rated  as  Having  High  Ability  to  Perfonn, 


Ability  or  Skill 

History  and  Physical  Exam 

Use  problem  oriented  medical  record 

Evaluate  major  symptoms 

Obtain  a  medical  history 

Obtain  a  family  or  social  history 

Perform  a  routine  physical  exam 

Screening 

Determine  who  should  see  patient 
Determine  need  for  attention  from 
telephone  call 

Teaching 

Answer  patient's  questions  about 

treatments,  tests  or  disease 
Instruct  patient  about  treatments, 

tests  or  disease 
Answer  patient's  questions  about 

medication 
Instruct  patient  about  medication 
Plan  special  diets 

Chronic  Care 

arthritis 

angina 

diabetes 

CHF 

hypertension 

obesity 

stroke 

chronic  lung  disease 

Acute  Care 

VD 

URI 

UTI 

headache 

minor  trauma 

Communicate  with  Physician 

Write  Prescriptions 

Autonomy 

Make  housecalls  without  physician 
Care  for  patient  without  direct 
supervision  of  physician 


% 

Hig 

h  Ability  to  Perform 

High  Change 

Medium  or  Low 

Change 

Group 

Group 

50% 

8 

89% 

N 
9 

87% 

8 

82% 

11 

100% 

8 

73% 

11 

100% 

8 

100% 

11 

100% 

8 

70% 

10 

82% 

8 

91% 

11 

100% 

8 

90% 

10 

100% 

8 

91% 

11 

100% 

8 

100% 

11 

100% 

8 

91% 

11 

100% 

8 

91% 

11 

75% 

8 

60% 

10 

50% 

8 

57% 

7 

88% 

8 

75% 

8 

88% 

8 

89% 

9 

100% 

8 

88% 

8 

100% 

8 

89% 

9 

88% 

8 

89% 

7 

72% 

7 

72% 

7 

78% 

8 

72% 

7 

43% 

7 

38% 

8 

100% 

8 

89% 

9 

71% 

7 

88% 

8 

75% 

8 

60% 

10 

100% 

A 

78% 

9 

100% 

8 

100% 

11 

86% 

7 

63% 

8 

63% 

8 

67% 

6 

63% 

8 

63% 

8 
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One  should  note  that  in  the  area  of  chronic  care,  44  per  cent  of  the 
items  are  independent  of  change  in  the  job.   This  is  quite  surprising  in 
view  of  the  consistent  relationship  found  between  job  change  and  ability 
in  the  other  areas.   However,  as  we  have  shown  in  Part  II  and  Table  2.1, 
while  the  rating  of  the  Nurse  Practitioner  Program  was  not  noticeably  lower 
in  the  chronic  area,  the  Nurses'  self-assessment  was.   Clearly,  the  nurses 
feel  less  confident  in  their  ability  to  deal  with  the  chronically  ill  in 
these  nine  areas. 

Our  belief  is  that  the  nurses  are  not  getting  as  great  an  opportunity 
to  treat  the  chronically  ill  as  they  feel  they  need  in  order  to  be 
competent  in  this  area.   In  the  chronic  care  area  the  physician  seems  to 
be  rating  the  nurse  slightly  higher  than  the  nurse  rates  herself.   This 
is  probably  a  result  of  the  physician  basing  his  assessment  on  the  nurse's 
knowledge  rather  than  on  observation.   This  view  is  supported  by  the  fact 
that  the  frequency  of  "don't  know"  answers  by  the  physicians  increases 
in  the  chronic  area. 
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PART  VI 
IMPLICATIONS 


We  feel  that  this  study  has  implications  in  two  broad  areas. 
First,  there  are  implications  for  the  general  problem  of  the  assessment 
of  educational  impact  and  for  the  kind  of  research  that  should  be  done 
in  that  area.   Second,  there  are  implications  for  the  management  of  change 
in  certain  aspects  of  the  health  care  delivery  system. 

In  the  first  area,  the  study  implies  that  evaluation  of  any  program, 
but  specifically  educational  programs,  be  conducted  in  their  larger 
context,  rather  than  in  isolation.   In  the  past,  many  individuals  have 
attempted  to  isolate  "educational  outcomes".   However,  as  should  be  clear 
from  this  study,  it  is  very  difficult  to  separate  the  learning  that 
occurred  in  this  program  from  the  learning  the  nurses  had  obtained  in  the 
past.   This  difficulty  arises  both  for  learning  obtained  formally  in 
nursing  education  and  more  informalJy  on  the  job.   Therefore,  it  makes 
little  sense  to  examine,  for  example,  the  learning  about  a  particular 
disease  without  relating  this  to  previous  education  and  experience. 

Furthermore,  the  transfer  of  any  learning  to  the  job  involves 
many  factors,  only  some  of  which  we  have  been  able  to  isolate  in  this 
study.   The  attitudinal  factors  such  as  expectations,  structural  factors 
such  as  changes  in  office  practices,  and  some  of  the  social  factors 
which  in  our  study  took  the  form  of  social  support  >   play  a  vital  role 
in  understanding  the  process  of  transfer  of  learning  to  the  job. 
Those  concerned  with  the  management  of  the  health  care  delivery  system 


28 


should  pay  particular  attention  to  this  transfer  of  learning  and  its  sub- 
sequent impact  on  patient  care.    In  other  words,  it  is  short  of  the 
desired  target  to  isolate  "educational  impact"  without  gaining  an  under- 
standing of  its  practical  consequences. 

Finally,  the  changes  we  have  isolated  in  the  nurses'  duties  two  months 
after  they  completed  the  program  give  us  only  an  indication  of  the  changes 
that  will  occur  in  the  future.   To  further  illuminate  this  process  of  change, 
it  is  necessary  to  study  the  nurses  over  an  extended  period  of  time;     for 
a  "snapshot"  evaluation  strategy  is  incomplete,  if  not  possibly  misleading. 
At  present,  a  study  team  at  Massachusetts  (General  Hospital  is  continuing  to 
follow  the  twenty-nine  nurses  in  our  sample  in  order  to  determine  whether 
the  changes  we  have  highlighted  continue. 

The  implications  for  the  management  of  change  in  the  health  care  delivery 
system  draw  directly  from  our  observations  during  this  study.   We  feel  that 
it  is  necessary  to  influence  a  number  of  factors  that  condition  the  transfer 
of  knowledge  to  the  care  setting.   In  the  case  of  the  Nurse  Practitioner 
Program,  the  organizers  spent  a  considerable  amount  of  time  and  energy  both 
recruiting  physicians  and  nurses  who  genuinely  felt  the  need  for  change  in 
the  nurse's  role  and  communicating  with  the  physicians  to  help  thera  utilize 
the  "new  resource." 

However,  the  expansion  of  this  or  other  programs  makes  a  recruitment 
and  communication  strategy  somewhat  ineffective.   Clearly,  there  will 
be  cases  in  which  the  physician  and/or  the  nurse  do  not  feel  the  need  for 
change,  or  other  cases  where  there  is  resistance  to  giving  up  old 
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procedures,  to  hiring  more  staff,  obtaining  more  space,  etc.   These 
situations  necessitate  other  mechanisms  for  the  management  of  the 
attitudinal,  social,  and  structural  factors  to  insure  that  the  resources 
expended  in  the  education  of  the  nurse  are  fully  utilized.   In  other 
words,  the  isolated  educational  intervention  is  not  necessarily  sufficient 
to  produce  change  in  the  care  setting.   Therefore,  other  procedures,  per- 
haps in  the  area  of  training,  would  have  to  be  implemented  in  order  to 
facilitate  the  utilization  of  newly  acquired  knowledge  and  skills. 
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